Backpropagation Algorithm Adaptation Parameters Using Learning Automata

New Learning Automata Based Algorithms for Adaptation of Backpropagation Algorithm Parameters

One popular learning algorithm for feedforward neural networks is the backpropagation (BP) algorithm which includes parameters, learning rate (eta), momentum factor (alpha) and steepness parameter (lambda). The appropriate selections of these parameters have large effects on the convergence of the algorithm. Many techniques that adaptively adjust these parameters have been developed to increase...

Adaptation of Momentum Factor and Steepness Parameter in Backpropagation Algorithm Using Fixed Structure Learning Automata

New Classes of Learning Automata Based Schemes for Adaptation of Backpropagation

One popular learning algorithm for feedforward neural networks is the back.propagation (BP) algorithm which includes parameters: learning rate (1]), momentum factor (n) and steepness parameter (A.).The appropriate selections of these parameters have a large effect on the convergence of the algorithm. Many techniques that adaptively adjust these parameters have been developed to increase speed o...

Experimentation on Learning Automata Based Methods for Adaptation of BP Parameters

The backpropagation learning algorithm has number of parameters such learning rate (η), momentum factor (α) and steepness parameter (λ). whose values are not known in advance, and must be determined by trail and error. The appropriate selection of these parameters have large effect on the convergence of the algorithm. Many techniques that adaptively adjust these parameters have been developed t...

Introducing an Adaptive VLR Algorithm Using Learning Automata for Multilayer Perceptron

One of the biggest limitations of BP algorithm is its low rate of convergence. The Variable Learning Rate (VLR) algorithm represents one of the well-known techniques that enhance the performance of the BP. Because the VLR parameters have important influence on its performance, we use learning automata (LA) to adjust them. The proposed algorithm named Adaptive Variable Learning Rate (AVLR) algor...